A Hybrid Framework for Modeling Comprehensible Human Gesture
نویسندگان
چکیده
A bs tr act. We attempt to find the suitable modeling for complex gesture patterns so that we can utilize it for their recognition and reproduction. As a result, we propose a hybrid framework where the observable characteristics of gestures are modeled explicitly, while pattern details are processed by blind learning methods. Our hybrid approach thus consists of multiple layers with inter-communicating mechanism between them. They are attribute-level trackers(AT), a gesture-level tracker(GT), and a situation-tracker(ST). AT deals with low-level pattern variations of human action and also has main responsibility for the segmentation of continuous action stream. GT deals with the temporally coordinated characteristics of concurrent attributes and ST keeps track of application-specific context knowledge. The overall model for comprehensible gestures could also serve as a global framework for generating gesture animation.
منابع مشابه
Human Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملQuantative Evaluation of the Efficiency of Facial Bio-potential Signals Based on Forehead Three-Channel Electrode Placement For Facial Gesture Recognition Applicable in a Human-Machine Interface
Introduction: Today, facial bio-potential signals are employed in many human-machine interface applications for enhancing and empowering the rehabilitation process. The main point to achieve that goal is to record appropriate bioelectric signals from the human face by placing and configuring electrodes over it in the right way. In this paper, heuristic geometrical position and configuration of ...
متن کاملNeural Network Performance Analysis for Real Time Hand Gesture Tracking Based on Hu Moment and Hybrid Features
This paper presents a comparison study between the multilayer perceptron (MLP) and radial basis function (RBF) neural networks with supervised learning and back propagation algorithm to track hand gestures. Both networks have two output classes which are hand and face. Skin is detected by a regional based algorithm in the image, and then networks are applied on video sequences frame by frame in...
متن کاملGesture sequence recognition with one shot learned CRF/HMM hybrid model
In this paper, we propose a novel markovian hybrid system CRF/HMM for gesture recognition, and a novel motion description method called gesture signature for gesture characterisation. The gesture signature is computed using the optical flows in order to describe the location, velocity and orientation of the gesture global motion. We elaborated the proposed hybrid CRF/HMM model by combining the ...
متن کامل